Retarded Learning: Rigorous Results from Statistical Mechanics
نویسندگان
چکیده
منابع مشابه
Retarded learning: rigorous results from statistical mechanics.
We study learning of probability distributions characterized by an unknown symmetry direction. Based on an entropic performance measure and the variational method of statistical mechanics we develop exact upper and lower bounds on the scaled critical number of examples below which learning of the direction is impossible. The asymptotic tightness of the bounds suggests an asymptotically optimal ...
متن کاملStatistical mechanics of learning from examples.
Learning from examples in feedforward neural networks is studied within a statistical-mechanical framework. Training is assumed to be stochastic, leading to a Gibbs distribution of networks characterized by a temperature parameter T. Learning of realizable rules as well as of unrealizable rules is considered. In the latter case, the target rule cannot be perfectly realized by a network of the g...
متن کاملRetarded Electromagnetic Interaction and Dynamic Foundation of Classical Statistical Mechanics
It is provided in the paper that the non-conservative dissipative force and asymmetry of time reversal can be naturally introduced into classical statistical mechanics after retarded electromagnetic interaction between charged micro-particles is considered. In this way, the rational dynamic foundation for classical statistical physics can established and the revised Liouville’s equation is obta...
متن کاملStatistical mechanics of fluids under internal constraints: Rigorous results for the one-dimensional hard rod fluid
The rigorous statistical mechanics of metastability requires the imposition of internal constraints that prevent access to regions of phase space corresponding to inhomogeneous states. We derive exactly the Helmholtz energy and equation of state of the one-dimensional hard rod fluid under the influence of an internal constraint that places an upper bound on the distance between nearest-neighbor...
متن کاملStatistical Mechanics of Learning
We review the application of statistical mechanics methods to the study of online learning of a drifting concept in the limit of large systems. The model where a feed-forward network learns from examples generated by a time dependent teacher of the same architecture is analyzed. The best possible generalization ability is determined exactly, through the use of a variational method. The construc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Physical Review Letters
سال: 2001
ISSN: 0031-9007,1079-7114
DOI: 10.1103/physrevlett.86.2174